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In macroevolutionary studies, different approaches are commonly used to measure phylogenetic signal—the tendency of related 
taxa to resemble one another—including the K statistic and the Mantel test. The latter was recently criticized for lacking statistical 
power. Using new simulations, we show that the power of the Mantel test depends on the metrics used to define trait distances 
and phylogenetic distances between species. Increasing power is obtained by lowering variance and increasing negative skewness 
in interspecific distances, as obtained using Euclidean trait distances and the complement of Abouheif proximity as a phylogenetic 
distance. We show realistic situations involving “measurement error” due to intraspecific variability where the Mantel test is more 
powerful to detect a phylogenetic signal than a permutation test based on the K statistic. We highlight limitations of the K-statistic 
(univariate measure) and show that its application should take into account measurement errors using repeated measures per 
species to avoid estimation bias. Finally, we argue that phylogenetic distograms representing Euclidean trait distance as a function 
of the square root of patristic distance provide an insightful representation of the phylogenetic signal that can be used to assess 


both the impact of measurement error and the departure from a Brownian evolution model. 


KEY WORDs: Abouheif proximity, Euclidean distance, intraspecific variability, Mantel test, measurement error, phylogenetic 


distogram, phylogenetic signal. 
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Characterizing phylogenetic signal, that is, the tendency of related 
species to resemble one another, is often a key point to assess 
macroevolutionary patterns in comparative biology (Losos 2008; 
Revell et al. 2008). To this end, many different approaches have 
been developed (e.g., Abouheif 1999; Diniz-Filho 2001; Freckle- 
ton et al. 2002; Blomberg et al. 2003; Ives et al. 2007; Pavoine 
et al. 2008, 2010; Zheng et al. 2009; Fritz and Purvis 2010; Ives 


and Garland 2010; Jombart et al. 2010). They include the Man- 
tel matrix correlation between a matrix of pairwise phylogenetic 
distances and of pairwise phenotypic distances between species. 
In a recent article, Harmon and Glor (2010) criticized the use of 
the Mantel test (1) to test for phylogenetic signal because it lacks 
power and (2) to test for the evolutionary correlation between two 
characters because it is then liberal. Although we think the second 
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statement is well justified, here we argue that the first one is not. 
We show realistic situations where the Mantel test proves more 
powerful to detect phylogenetic signal than a permutation test us- 
ing Blomberg et al.’s (2003) K statistic, the alternative approach 
supported by Harmon and Glor (2010), especially when measure- 
ment errors (MEs) cannot be accounted for in the K statistic. 


Testing Power of the Mantel Test 
and the K Statistic 


Testing for a phylogenetic signal using the Mantel test requires 
two matrices, one for trait distances and one for phylogenetic 
distances among species. Hereafter, we denote E the matrix of 
Euclidean distances among species traits and P the patristic dis- 
tances among species on the phylogeny (sum of branch lengths 
linking species). Harmon and Glor (2010) considered, respec- 
tively, E? (squared Euclidean distances) and P in their analysis 
of the power of the Mantel test because they are expected to vary 
proportionally under Brownian evolution. However, the choice of 
the distance measures affects the power of the Mantel test, a point 
neglected by Harmon and Glor (2010). To assess this point, we 
performed numerical simulations in the R statistical software (R 
Development Core Team 2011) and will mention hereafter the 
main functions and contributed R packages used to this end (see 
Supporting information for the R code). 

As an alternative to E? for trait distances, one can consider E, 
which is expected to increase proportionally with P!/? (the square 
root of patristic distance, computed using the function “cophe- 
netic.phylo” from the R package “ape,” Paradis et al. 2004). Sim- 
ulations generated under a birth—death process (using function 
“sim.bd.taxa” from the R package “TreeSim,” Stadler 2011) and 
where the evolution of a trait followed a Brownian motion model 
(using the function ‘rTraitCont’ from the R package “ape,” Par- 
adis et al. 2004) without ME (equivalent to Harmon and Glor 
2010), show that the Mantel test (performed using the function 
“mantel” from the R package “vegan,” Oksanen et al. 2011) be- 
comes more powerful when using E and P!/? rather than E? and 
P (Fig. 1A). Still higher testing power (Fig. 1A) can be achieved 
using an alternative phylogenetic distance derived from Abouheif 
(1999) and formalized by Pavoine et al. (2008), which can be com- 
puted using the function “proxTips,” method = “oriAbouheif,” 
from the R package “adephylo” (Jombart and Dray 2008) with 
a dependency on package “phylobase” (Hackathon et al. 2011). 
Abouheif proximity is 1/2” where n is the number of nodes sepa- 
rating species i and j. This formula is valid for a fully dichotomous 
tree, see Pavoine et al. (2008) for the case of polytomies. Never- 
theless, under a Brownian evolution model (BM) and also under 
an Ornstein—Uhlenbeck model (OU; results not shown), the power 
of the Mantel test using Euclidean trait distances and the com- 
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plement of Abouheif proximity closely approaches but remains 
inferior to the power of the K statistic (Fig. 1A), which can be 
computed using the function “phylosig,” method = “K” and se = 
NULL, from the R package “phytools” (Revell 2011). 

This pattern changes when traits display some level of “mea- 
surement error”, which can account both for limited measurement 
precision and actual phenotypic variation within species (Ives 
et al. 2007). To simulate this case, after evolving a trait under 
BM, replicates of trait measures were obtained for each species by 
adding normally distributed random terms to the intrinsic species 
trait value (model BM + ME). The K statistic was then estimated 
either using only the mean trait values per species and neglecting 
ME (K) following Blomberg et al. (2003), or by integrating also 
the estimated standard errors (se) of the mean values for each 
species (Kse) following Ives et al. (2007; using the R function 
“phylosig”, method = “K” and se = standard errors per species). 
As can be seen in Fig. 1B, for a dataset of 25 species where the 
variance of the error terms (1.e., the precision) is constant among 
species, the Mantel test using Euclidean distances and the com- 
plement of Abouheif proximity becomes more powerful than the 
test on K as soon as at least about 10% of the observed pheno- 
typic variance is due to ME. When ME is accounted for, however, 
the test on Kse becomes nearly as powerful as the best Mantel 
tests. Taking into account the precision of phenotypic measures 
for each species in Kse becomes even more interesting when this 
precision varies among species because the test on Kse can then 
become much more powerful than any Mantel test (Fig. 1C). In 
our simulations with 25 species where the standard deviation (SD) 
of the error terms followed a log-normal distribution with a mean 
equal to the interspecific SD of the intrinsic phenotypic values, 
this occurred when the coefficient of variation of the log-normal 
distribution was above about 0.35 (Fig. 1C). The precision of the 
phenotypic measures of each species could also be taken into 
account in the Mantel test by redefining the Mantel correlation 
statistic and this might provide an increase in testing power sim- 
ilar to the one observed with Kse. However, this development is 
beyond the scope of the present article. 

Besides the precision of phenotypic measures, another im- 
portant factor affecting the power of all the tests is the shape of the 
phylogenetic tree. In particular, the power tends to decrease when 
most speciation events are concentrated near the root (Fig. 1D, 
right, obtained by transforming the original tree using the func- 
tion “deltaTree” from the R package “geiger,” Harmon et al. 2009, 
with a parameter delta = 10). However, the relative impact varies 
among the tests and, when 50% of the observed phenotypic vari- 
ance is due to ME, both the K and Kse tests can become less 
powerful than all Mantel tests when most speciation events are 
very recent (Fig. 1D, left, with delta = 0.1). The conclusion of 
Harmon and Glor (2010) about the low power of the Mantel test 


was thus based on an insufficient analysis of the different possible 
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Figure 1. Statistical power (1 — type II error, for a nominal type I error rate « = 0.05) for tests of phylogenetic signal using the K and Kse 
statistics (thin and thick solid lines, respectively), and Mantel tests (discontinuous lines) with different trait and phylogenetic distance 
measures: squared Euclidean distance and patristic distance (as in Harmon and Glor 2010), Euclidean distances and square root (patristic 
distances), Euclidean distances and the complement of Abouheif proximity, the distance J; used in Moran’s autocorrelation metric and 
Abouheif proximity (which gives the same power as Abouheif test). In each case, 1000 simulated datasets were analyzed for a range 
of tree sizes (A, where an original tree of 100 species was pruned to keep from five to 55 species) or for trees with 25 taxa (B, C, and 
D). Each tree was generated under a birth-death process model. The evolution of a single trait was simulated under Brownian motion 
model without measurement error (A; model BM) or with measurement error (B, C, and D; model BM + ME, simulating four measures per 
species) where the proportion of the phenotypic variance among species due to the error terms ranged from 0 to 1 (B) or was fixed to 
0.5 (C and D). Although the precision (i.e., standard deviation of the error terms) of the phenotypic values were constant among species 
in (B) and (D), in (C) it varied according to a log-normal distribution with a coefficient of variation (CV) ranging from 0 to 1.3. In (D), 
the phylogenetic trees generated under a birth-death process (central) were transformed to concentrate speciation events late (right) or 
early (left) in the tree (with a parameter delta of 0.1 and 10, respectively; inserted trees represent examples for one replicate). 


ways to apply the Mantel test and of the different scenarios of trait power by stabilizing to some extent the variance (Fig. 2C). How- 
evolution. ever, this improvement does not necessarily occur under BM + 

The increased power of the Mantel test using E rather than ME (Fig. 3) because the variance of the Euclidean distance is then 
E? might result from a lowering of variance and/or an increase in less strongly related to patristic distance (Fig. 2D). It is worth not- 
negative skewness of interspecies trait distances (Fig. 2A, B). In ing that all Mantel tests considered, as well as K and Kse tests, 
fact, the power of the Mantel test can still be slightly increased displayed adequate type I error rate (i.e., rate of false positive) 
by taking E!/? against P!/4 under BM (Fig. 3). Under BM, the when trait values following a normal distribution were assigned 
variance of the Euclidean distance increases with the patristic dis- randomly to each species (Fig. 1B when the proportion of variance 
tance (Fig. 2B) so that the root transformations might improve the due to ME reaches 1). Hence, the transformations of Euclidean 
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Figure 2. Relationship between Euclidean distance and patristic distance after different transformations for a tree of 200 taxa generated 
under a birth-death process and where 100 independent traits were simulated under a Brownian motion model without measurement 
error (A, B, C represent results from the same simulation run under model BM) or with measurement error accounting for 50% of the 
phenotypic variance for each trait (D, under model BM + ME). Note that the chosen transformations of Euclidean and patristic distances 
maintain linear relationships under the models simulated but they change the variance and the skewness of the distributions. 


and patristic distances do not cause any trade-off between type I 
error rate and power (i.e., 1 — type H error rate = 1 — rate of false 
negative). 

The increased power brought by Abouheif proximity has al- 
ready been shown by Pavoine et al. (2008) when comparing tests 
of phylogenetic signal based on Morans’ I statistic (Abouheif 
proximity is here used in the weighting matrix of Moran’s /). In 
fact, the simulations conducted indicate that the Mantel test using 
Euclidean distances (E) and the complement of Abouheif prox- 
imities was slightly more powerful than the Moran’s / test using 
Abouheif proximities under BM (Fig. 1A), but not necessarily 
under BM + ME (Fig. 1B). These differences should result from 


the trait distance metric (in fact a trait proximity metric) implicit 
in Moran’s J that is an autocorrelation coefficient defined as Jj; = 
(Xi — Xm)Qj — Xm)/V(x), where x; and x; are the trait values of 
species 7 and j, whereas Xm and V(x) are the mean and variance 
of the trait values over all species. Indeed, the same power is 
achieved using J;; and Abouheif proximities in the Mantel test 
or Abouheif proximities in Moran’s / test (i.e., Abouheif’s test; 
Fig. 1A, B). In general, the highest power for the Mantel test was 
achieved using Abouheif proximities combined with Euclidean 
distance or J;;. However, when most speciation events occur early 
in the tree (long branches to the tips) and traits evolve under BM, 


Mantel tests become more powerful using patristic distances than 
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Figure 3. Statistical power of Mantel tests with different trait and phylogenetic distance measures: (Euclidean distance)* and patristic 
distances, Euclidean distance and (patristic distances)'/2, (Euclidean distance)'/2 and (patristic distances)'/4, Euclidean distances and the 
complement of Abouheif proximity, (Euclidean distance)'/2 and the complement of Abouheif proximity. In each case, 1000 simulated 
datasets were analyzed for trees with 15 taxa generated under a birth-death process where the evolution of one to 10 independent traits 
was simulated under Brownian motion model without measurement error (the five curves above, model BM) or with 50% of variance 
per trait due to measurement error (the five curves below, model BM + ME). 


Abouheif proximities (results not shown); although when ME is 
added, Mantel tests associated with Abouheif proximities have 
slightly higher power (Fig. 1D, right). 

The fact that a phylogenetic distance neglecting branch 
lengths (Abouheif proximity depends only on tree topology) can 
confer more power than patristic distance along the phylogeny 
might seem counterintuitive. The Abouheif proximity between 
two species is inversely proportional to the number of equivalent 
tree configurations (obtained by switching the order of branches 
descending from each node) modifying the relative position of the 
two species. When testing for a phylogenetic signal by random 
permutations of the species among the tips of the phylogeny (as 
for Mantel and Moran’s Z tests), Abouheif proximity conveys in- 
formation on the number of permutations that change the relative 
positions of the species for equivalent trees. In addition, the distri- 
bution of Abouheif proximity shows substantial skewness. These 
characteristics of Abouheif proximity may be involved in its good 
testing power, although a formal mathematical justification is still 
lacking. 


Limitations of the K Statistic and the 
Importance of ME 


An important result brought by the simulations is that ME lowers 
substantially the power of Blomberg et al.’s (2003) K-test and 
affects this test more than the Mantel tests considered, eventu- 
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ally reversing their respective powers. K, which was designed 
to quantify deviation from BM (under which K = 1, which is 
indeed the estimated value in the absence of ME, Fig. 1A), is 
also substantially biased downward by ME (Fig. 1B) and this 
bias is stronger when speciation events are concentrated near the 
tips (Fig. 1D, left). This weakness of the original K statistic was 
addressed by Ives et al. (2007) who developed an estimator ac- 
counting for ME (Kse statistic) and requiring several measures 
per species to estimate the standard error of the mean value of 
each species. Interestingly, accounting for ME in Kse increases 
its power compared to K. 

In our simulations, although K and Kse were close to | under 
BM without ME (Fig. 1A), K dropped to about K = 0.6 with 
only one-tenth of variance due to ME and to about K = 0.25 
with half of the variance due to ME (Fig. 1B), and in the latter 
case it even dropped to as low as K = 0.05 when most speciation 
events are recent (Fig. 1D, left). By contrast, Kse remained much 
more stable but also displayed some downward bias, sometimes 
reaching Kse = 0.5 (thick gray lines in Fig. 1B—D; see also Zheng 
et al. 2009). In fact, K is very sensitive to trait differences between 
very closely related species. Hence, K drops quickly when ME 
occurs or when the phylogeny is inaccurate among closely related 
species (as is often the case). However, ME and inaccurate phy- 
logeny reconstruction can also counterbalance; this occurs when 
the branches lengths of the tips are overestimated because, under 
BM, this precisely mimics the effect of ME, so that K departs 


less from unity. The downward bias of Kse under ME (Fig. 1B- 
D) originates from the fact that the standard errors of the mean 
trait values per species were estimated using four simulated mea- 
sures per species and were thus not very precise. Indeed, in the 
simulated conditions of Fig. 1D (central tree) where half of the 
phenotypic variance is due to ME, Kse = 0.75, 0.90, 0.98, and 
1.00 when the precision is estimated with 4, 10, 30, and 100 mea- 
sures per species, respectively. Increasing the number of measures 
per species would not, however, reduce a bias in the Kse value 
due to inexact branch lengths in the phylogenetic tree. 

A limitation of K or Kse is that they are univariate while one 
may be interested in assessing the phylogenetic signal of a set of 
traits. By contrast, Euclidean distance can be estimated for a set of 
traits and the power to detect a signal using Mantel tests increases 
substantially with the number of traits (Fig. 3), a behavior also 
noticed by Zheng et al. (2009) who developed another multivariate 
test of phylogenetic signal. 

Is ME important in real datasets? First, it must be noted 
that intraspecific variation is the rule for continuous quantitative 
phenotypic traits. Considering different measures of dispersal in 
European butterflies, Stevens et al. (2010) found that intraspecific 
variability represented from 11% to 133% of the interspecific vari- 
ability. For adult body mass, a coefficient of variation of at least 
0.1 or 0.2 among individuals of the same species is likely the 
rule for most animal species. If the tips of a phylogenetic tree 
represent genera or families rather than species, the associated 
variance would still increase further. When the interspecific vari- 
ation of the sampled species is huge, as for the adult body mass of 
all mammals that range over about eight orders of magnitude (2 
g for the bumblebee bat to 200 tons for the blue whale), ME can 
be negligible because after a logarithmic transformation of body 
mass to stabilize variances and approach normality, intraspecies 
phenotypic variation will remain very small in comparison to 
interspecific variation. However, when interspecific variation is 
limited, as for example among the body masses of wild canid 
species or for wood relative density that varies within about an or- 
der of magnitude (range = 0.11-1.39, mean + SD = 0.65 + 0.18 
among about 2500 neotropical tree species, Chave et al. 2006), 
within-species variation can be comparatively substantial. ME can 
nevertheless be reduced by averaging measures taken over many 
individuals representative of the range of variation but this is not 
always feasible. For example, in Chave et al. (2006) study, wood 
densities of 60% of the species were based on a single reported 
measure and the average SD in species with multiple reported 
measures was 0.07, so that about 15% (0.077/0.187) of the phe- 
notypic variance would be due to ME if a single measure was 
available per species. This fraction would decrease proportion- 
ally to n—'/? if n measures per species are available. This example 
shows a situation where a Mantel test applied using appropriate 


distance measures was shown to perform better than a test based 


BRIEF COMMUNICATION 


on the K statistic. Harmon and Glor (2010) might nevertheless be 
right in assuming that the Mantel test is not the most powerful 
way for detecting a phylogenetic signal but we need a more com- 
prehensive study of the different tests proposed so far (see, e.g., 
Freckleton et al. 2002; Pavoine et al. 2008, 2010; Zheng et al. 
2009; Fritz and Purvis 2010; Ives and Garland 2010). 


Alternative Ways to Characterize a 
Phylogenetic Signal: Phylogenetic 
Autocorrelograms and Distograms 
When a phylogenetic signal is detected, researchers may be in- 
terested in inferring what process(es) generated the pattern. Dif- 
ferent model-selection approaches have been developed to this 
end (Harmon et al. 2010). Blomberg et al.’s (2003) K is often 
used to assess whether there is less (K < 1) or more (K > 1) 
phylogenetic signal than under BM but it is important to real- 
ize that different phenomena can affect the K-value in the same 
way (e.g., both stabilizing selection in the OU process and ME 
reduce K). Ives et al.’s (2007) Kse can at least partially resolve 
this by accounting for ME, provided that a standard error can 
be estimated for each species (e.g., several measures available). 
However, the actual process(es) that generated a particular pattern 
may be masked by standard model-selection approaches because 
a limited number of alternative models can be tested. Alterna- 
tively, phylogenetic autocorrelograms (average Jj; values over a 
set of phylogenetic distance intervals, Fig. 4A; Diniz-Filho 2001) 
or phylogenetic distograms (average Euclidean distance between 
species over a set of phylogenetic distance intervals, Fig. 4B) 
clearly show that contrasted patterns of phylogenetic signals are 
obtained when there is selection toward a unique optimum (OU 
model, Blomberg et al. 2003) or when ME occurs (BM + ME), 
differences that are not captured using the K statistic. For exam- 
ple, for the simulations presented in Figure 4, K = 0.34 for the 
OU model with alpha = 3 as well as for the BM + ME model with 
10% of phenotypic variance due to ME. Therefore, investigating 
patterns of trait evolution using phylogenetic autocorrelograms 
or distograms can be very informative and does not assume an 
explicit model. In the simulated examples, distograms using Eu- 
clidean distance against the square root of the patristic distance 
allowed distinguishing BM (linear relationship going through the 
origin), OU (concave relationship going through the origin) and 
BM + ME (linear relationship with a positive intercept) models 
(Fig. 4B). More generally, regressing pairwise J; or Euclidean 
distances between species on patristic or square root of patris- 
tic distances, respectively, can provide useful information on the 
nature of the phylogenetic signal. Indeed, the correlation coeffi- 
cient, which can be tested using the Mantel test, would inform 
on the direction and strength of the signal, the intercept would 
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Figure 4. Phylogenetic autocorrelogram (A) and phylogenetic 
distogram (B) representing, respectively, the average similarity 
lj used in Moran's autocorrelation metric (A) or the average Eu- 
clidean distance (B) between taxa for a set of patristic distance 
intervals. Evolution of a single trait was simulated under differ- 
ent models on a phylogeny of 250 taxa (average values over 200 
simulation replicates are given). BM: Brownian evolution model. 
OU: Ornstein-Uhlenbeck model with parameter alpha = 1 (curve 
closest to BM) or 3. BM + ME: Brownian evolution model includ- 
ing measurement error where the total phenotypic variance due 
to measurement error = 10% (curve closest to BM) or 50%. No 
phylogenetic signal: trait values randomly chosen from a normal 
distribution. Note that the scales of the x-axes are different for 
panels A and B but ensure in each case that the relationship is 
(near) linear under BM. The 10 patristic distance intervals were 
defined by their respective upper limits as (k/10)* for interval k 
(1-10), after rescaling patristic distances so that the maximum 
value is 1. 


quantify the degree of ME (ina broad sense including intraspecific 
variation), and the curvature of the relationship would quantify 
the degree of departure from BM after factoring out the effect of 
ME. Hence, distograms may illuminate some peculiarities of the 
processes yet to be explicitly modeled. They should push model 
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development in promising new directions and should reveal where 
current models are currently failing. This should be increasingly 
important as tree size used in comparative analysis is evermore 
increasing. 

Interestingly, this approach also works using multiple traits 
because the Euclidean distance using all traits still increases pro- 
portionally to the square root of patristic distance (Fig. 2). It must 
be noted, however, that large phylogenies and/or many traits are 
required to limit the noise inherent in the stochasticity of evo- 
lutionary processes. Indeed, the relationships between pairwise 
Euclidean and patristic distances presented in Figure 2 are clear 
because 100 independent traits were simulated simultaneously 
but if a single trait was considered, the points would be dispersed 
in a triangular fashion because phylogenetically distant species 
could share similar trait values by chance. To clarify such noisy 
patterns, pairwise Euclidean distances can be averaged over a set 
of patristic distance intervals, as done in Figure 4B, but fairly 
large phylogenies are nevertheless needed to assess, for example, 
whether the relationship remains linear or not (departure from 
BM). Alternative approaches decomposing the phylogenetic sig- 
nal among nodes have also been proposed by Jombart et al. (2010) 
and Pavoine et al. (2010). 


Conclusion 

The power of the Mantel test depends on the metrics used to 
define trait distances and phylogenetic distances among species. 
Increasing power seems to be obtained by lowering variance and 
increasing negative skewness in phylogenetic and interspecific 
trait distances, for example, using Abouheif proximities combined 
with Euclidean distance or J;;. In case of ME or phylogenetic inac- 
curacy among closely related species, Blomberg et al.’s (2003) K 
statistic is biased and the test of phylogenetic signal loses power 
but the approach of Ives et al. (2007) to account for ME largely 
corrects the bias and improves the power. This highlights the im- 
portance of having several phenotypic measures per species to 
be able to account for the precision in the mean phenotypic val- 
ues. None of the tests compared was found to be superior in all 
simulated conditions with univariate data. However, the Mantel 
test can also be used with multivariate trait distances, increas- 
ing substantially its potential range of applications. We argue that 
phylogenetic distograms might constitute an insightful alternative 
for characterizing and exploring the phylogenetic signal without 
assuming a specific model of evolution, at least when dealing 
with large datasets, and may illuminate some peculiarities of the 


underlying evolutionary processes. 
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